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ABSTRACT 

The language skills category of objectives of the 
Appalachia Preschool Education Program as measured by the Illinois 
Test of Psycholinguistic Abilities (ITPA) , is discussed. The point is 
made that one of the difficulties associated with evaluating language 
development is the loose fit between available theoretical and 
operational definitions of language. Often language is not 
theoretically defined at all and must be operationally defined by the 
particular evaluation instrument being used. Consequently, the 
theoretical model underlying the ITPA is considered to be applicable 
to the Appalachia program. The ITPA was a primary instrument in 
gathering data for the development of the preschool curriculum 
objectives. The text of this report gives an overview of the 
'instrument as well as separate descriptions for each subtest. Also, 
statistical descriptions and inferences are presented for each 
subtest. Three of the 10 subtests administered showed significant 
treatment of effects after covariance, indicating that there was some 
correspondence between program and test objectives. Findings indicate 
that a primary area of program effect is that of expressive language, 
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Detailed Analysis of the Language Development 
of Children in AEL's Preschool 
Education Program 

Introduction 

The original curriculum for the Appalachia Preschool Education Program 
was divided into four major categories --motor activities, language skills, 
cognition, and orienting and attending skills (Hooper and Marshall, 1968), 
This report Is concerned with the language skills category of objectives, 
as measured by the Illinois Test of Psychol inguis tic Abilities, 

One of the difficulties associated with evaluating language development 
is the loose fit between available theoretical and operational definitions 
of language. Often language is not theoretically defined at all and must be 
operationally defined by the particular evaluation instrument being used. 

This procedure has been followed for the summative evaluation of language 
growth in the AEL program. Consequently, the theoretical model underlying 
the Illinois Test, of Psycho] inguis tic Ability, the test used for language 
evaluation, is considered to be applicable to the Appalachia program. The 
definition of language used, therefore, was that of the authors of the ITPA. 

The ITPA was a primary instrument in gathering data for the development 
of the preschool curriculum objectives (Hooper and Marshall, 1968, pp, 76-89) 
Since this is so, it was assumed that the ITPA would measure many of the 
language objectives of the program as it proceeded through its three-year 
development cycle. The ITPA also has the advantage of being a nationally 
normed test and thus of providing comparisons with a large, representative 
sample of children outside of Appalachia. 

The text of this report will give an overview of the instrument as well 
as separate descriptions for each subtest. Following this, statistical des- 
criptions and inferences will be presented for each subtest. Finally, an 
overall summary of the findings for the third year's program effects on 
language development will be presented. 










The Model of the ITPA 



According to the authors } the purpose o£ the ITPA is to: 



Relate those functions whereby the intentions of one 
individual are transmitted (verbal ly or nonverbally) 
to another individual, and, reciprocally, functions 
whereby the environment or the intentions of another 
individual are received and interpreted. It attempts 
to interrelate the processes which take place, for 
example, when one person receives a message, interprets 
it, or becomes a source of a new signal to be trans- 
mitted, It deals with the psychological functions of 
the individual which operate in communication activi- 
ties (Kirk, McCarthy, and Kirk, 1968), 

It was hoped that not only would the child model his language behavior 
on the example provided by the paraprofessional, the teacher on the mobile 
facility, and the television teacher, but that in addition the paraprofessional 
would influence the parent's behavior in a manner which would produce in- 
creased rates of language development among children in the program. Addi- 
tionally, the program stresses nonverbal communication, listening skills, 
and vocabulary as well as verbal expression. Thus, the theoretical model 
of language just described is closely congruent with the objectives of the 
APEP. 

The ITPA itself consists of ten subtests, each of which attempts to 
measure a different aspect of language skills and those cognitive abilities 
which are related to language. These subtests overlap somewhat in the func- 
tions which they measure but cover the broad areas of auditory memory and 
acuity, verbal expression and grammar, syntax and transformations, and the 
ability to associate various auditory and visual stimuli, A total score 
for the test gives an overall picture of the individual's psycholinguistic 
functioning. The ITPA was administered pre and post-test by testers trained 
by AEL but not otherwise associated with the program. 

Although the ITPA’s major function is the identification of individual 
deficiencies in receptive or expressive language abilities, it has two 
advantages which qualify it as a major evaluation instrument. First, it 
was used to gather data in the pilot study by the Hooper and Marshall, and 
second, it provides national norms and data from a large number of other 
research projects with which to compare AEL' 5 progress,. 

Method of Analysis 

The primary statistical technique used to analyze the data from the 
ITPA was analysis of covariance on post-test scores, using chronological 
age and PPVT raw score as covariates. The eta-squared statistic is modified 
for the ANCOVA and indicates only the proportion of variance accounted for 
by the treatment, sex, treatment-^sex interaction , and error. An analysis 



of variance also was performed and showed significant effects across treat- 
ments on these two covariates . However, since the oldest group (TV only) 
consistently had the lowest overall mean scores, it is likely that covariance 
obscured some treatment effects which were actually present. For this rea- 
son ANOVA is considered a secondary analysis technique. Gain score analysis 
also was performed and will be reported where appropriate. 

Data were collected from a sample of approximately 300 children in June 
and September, 1970, as a pretest and in June, 1971, as a post-test. The 
sample v/as comprised of three treatment groups and a control group. The 
three treatments were: a group which took part in activities on a mobile 

classroom once a week and received weekly home visits from a paraprofessional 
as well as viewing a daily television program (TV-HV-MG) ; a group visited 
weekly by the paraprofessional and who also watched the television program 
(TV I IV) j and a group who only, watched the television program (TV only) . 

Additionally, a control group of 120 children was selected in Monon- 
galia County, West Virginia, and tested with the same battery of tests 
administered to the three treatment groups, A detailed description of the 
sampling procedure is included in the introduction to the total report. 

Description of ITFA Subtests and Data Analysis 

I TP A Subtest 1 (Auditory Reception ) 

Auditory reception measures the ability of a child to derive meaning 
from verbally presented material. Since the receptive rather than the 
expressive process is being sampled, the response throughout is kept at 
the simple level of a "yes" or "no" or even a nod or shake of the head. 

The vocabulary becomes more and more difficult while the response remains 
at a two-year level. Similarly, the automatic function of determining 
meaning from syntax has been minimized by retaining one sentence form. 

The test contains 50 short, direct questions printed in the manual. Typical 
items are* "Do dogs eat?" "Do dials yawn?" "Do carpenters kneel?" "Do 
wingless birds soar?" (Kirk, McCarthy, and Kirk, 1968, p. 9). 

It seems likely that this subtest measures functions more complex than 
the ability to hear and understand simple questions. At the very least it 
is responsive to the vocabulary level of the indivi dual , especially in the 
area of noun- verb relationships . 

Table 15,1 lists means, standard deviations, and sample sizes for each 
age by sex cell within the four treatment groups on Sub test 1, as well as 
overall means for each group for pre and post;- test measures. / 

To provide graphical comparison, Pigme 15,1 shows group means adjusted 
for analysis of covariance. ) Normative means for groups of similar ages are 
shown also for comparative .purposes. 



24 




Treatment Mean 
Normative Mean 




22.71 20.00 21.90 20.00 19.49 21.50 18.70 18.50 

TV-HV-MC TV-HV TV only Control 

62 mos. 62 mos. 65 mos. 59 mos. 



Figure 15.1 



Adjusted Overall Group Means and Normative Means for ITPA Subtest 1 (June, 
(Normative means differ because of differing treatment group ages) 




The differences between treatment means are not significant as Table 
15. 2 indicates. Eta^, a measure of the proportion of variance attribu- 
table to each source, also is included. Although neither sex nor treat- 
ment effects was present, it is of interest to note that all groups scored 
near the national norms for their mean age. This finding runs contrary 
to the traditional, view that Appalachian children are consistently behind 
their peers in language development. : y 
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Table 15.2 



Analysis 


of Covariance 


Table 


for ITPA Sub test 1 


(June, 1971) 




Source 


eta^ 


d.f. 


Mean Square 


F 




Trt . 


.01 


3 . 


62.76 


1.05 


NS 


Sex 


.00 


1 


6.67 : 


0.18 


NS 


Trt. by Sex 


.00 


3 


15.77 


0.41 


NS 


Covs . 




2 


84899.81 


2229.37 


— ■ 


Cov. 1 




1 


19. 79 


0.52 




Cov. 2 




1 


5474.82 


143.78 


— 


Error 


.98 


386 


38.08 







ITPA Subtest 2, Visual Reception (Visual Decoding) 

The visual reception test is comparable to the Auditory Reception Test 
but utilizes a different sense modality. It is a measure of the child 5 s 
ability to gain meaning from visual symbols. In this test there are 40 
picture items, each consisting of a stimulus picture on one page and four 
response pictures on a second page. The child is shown the stimulus picture 
for three seconds with the directions, "See this?" Then, the page of 
response pictures is presented with the direction, "Find one here." The 
credited choice is the object or situation which is conceptually similar 
to the stimulus. The other choices include pictures with varying degrees 
of structural (rather than functional) . similarity or pictures which are 
associated with the stimulus or with the acceptable choice (Kirk, McCarthy, 
and Kirk, 1968, p, 10). 

The title of this subtest is somewhat misleading since functions more 
complex than visual acuity are involved. It is possible that this type of 
matching- to-sample task is dependent on the ability to make logical classi- 
fications as well as simple visual reception. 

Table 15.3 gives mean scores, standard deviations, and sample size for 
each age and sex cell within the treatment and comparison groups as well as 
overall means for each treatment group on both pre and post- test measures. 

Using means from analysis of covariance adjusted for age in months and 
PPVT raw scores. Figure 15.2 illustrates the differences between treatment 
groups on ITPA Subtest 2 as well as comparisons with national norms for chil- 
dren of similar ages, . 
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Figure 15.2 

Adjusted Overall Group Means, and Normative Means for ITPA Sub test 2 (Jtine, 1971) 



As the analysis of covariance summary in Table 15-4 shows, the dif- 
ferences between group means are not statistically significant. It 
is of interest that three of the four groups did score at or above the 
national norms, continuing the pattern evident for Subtest 1. 



Table 15.4 



Analysis of Covariance Table for ITPA Subtest 2 (June, 1971) 



Source 



eta^ 



Trt . 

Sex 

Trt. by Sex 
Covs. 

Cov. 1 
Co v . 2 
Error 



52 

,00 

.00 



.48 



d.f. 



3 

1 

3 

2 

1 

1 

386 



Mean Square 



34.63 
0.61 
5.76 
42640.40 
183.91 
1777.91 
24 . 66 



1.40 
0 . 02 
0.23 
1729.16 
7.46 
72.10 



( 8 ) 



ERIC 






I TP A Sub test 3 (Audi tory- Vocal Association) 



Subtest 3 taps the child’s ability to relate concepts presented orally. 
In this test the requirements of the auditory receptive process and the 
vocal expressive process are minimal, while the organizing process of manip- 
ulating linguistic symbols in a meaningful way is tested by verbal analogies 
of increasing difficulty. A sentence completion technique is used in which 
one statement is followed by an incomplete analogous statement which the 
child is to complete. There are 42 orally presented analogies, such as, "I 

cut with a saw* I pound with a . ” "A dog has hair; a fish has 

(Kirk, McCarthy, and Kirk, 1968, p. 10.) 

Subtest 3 probably is an overall measure of the child’s ability to rea- 
son by analogies as well as a measure of his general knowledge of objects and 
their functions in the environment. Table 15.5 shows mean scores and sample 
sizes for each age and sex cell for the four groups as well as overall means 
for each. Data on both pre and post-test are shown. 

To provide graphical comparisons between group means and national norms. 
Figure 15.3 presents post- test means adjusted for age in months and PPVT raw 
scores, and normative means for comparable age groups. 
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Figure 15.3 

Adjusted Overall Group Means and Normative Means for ITPA Subtest 3 (June, 1971) 

Although . the differences between treatment group means are not. signifi- 
cant , as the ANCOVA summary table reveals, a large difference between the 
normative group and the TV only sample does exist. 



ci ty 





Table 15,6 



Analysis 


of Covariance 


Table 


for ITPA Sub test 3 


(June, 1971) 




Source 


eta^ 


d.f. _ 


Mean Square 


F 


P 


Trt. 


.01 


3 


32.05 


1.46 




Sex 


,00 


1 


72.78 


3,31 


- 


Trt. by Sex 


.00 


3 


1.84 


0.08 




Covs . 




2 


1.84 


2457,81 


- 


Cov. 1 




1 


44.96 


2.05 


- 


Cov, 2 


! 


1 


4772.53 


217.09 


- 


Error 


,98 


386 


21.98 







ITPA Subtest 4 (Visual-Motor Association) 

Subtest 4 uses a picture association test with which to assess the child's 
ability to relate concepts presented visually. The child is presented with a 
single stimulus picture surrounded by four optional pictures, one of which is 
associated with the stimulus picture. The child is asked, "What goes with 
this?" (pointing to the stimulus picture) "Which one of these?" (pointing to 
the four optional pictures). The child Is to choose the one picture which 
is most closely related to the stimulus picture, such as a sock belonging 
with a shoe, or a hammer with a nail. The test is expanded at the upper 
level to provide visual analogies comparable to the auditory analogies. 

"If this goes with this" (pointing to each of a preliminary pair of pictures) , 
"then what goes with this?" (pointing to the central picture as before). 

The test consists of 20 items of the simpler form and 22 visual analogies 
(Kirk, McCarthy, and Kirk, 1968, p. 10) . 

Intuitively, this subtest seems very similar to Auditory Association 
(Subtest 3) and the relatively high post- test correlation coefficient of 
.68 between the two measures provides empirical evidence of the similarity. 

In both cases the child's ability to reason by analogies and previous associa- 
tions is being tapped. 

Table 15.7 presents means, standard deviations, and sample sizes for 
each age by sex cell within the four treatment groups as well as the total 
scores for each group for both pre and post- test measures. 

Figure 15,4 presents adjusted group means from the analysis of covariance 
on post- test scores along with the normative means for each corresponding age 
group for Subtest 4, • 
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Figure 15.4 

Adjusted Overall Group Means and Normative Means for ITPA Subtest 4 (June , 1971) 



As the ANC0VA table reproduced in Table 15 . 8 . indicates , : differences be- 
tween group means on Subtest 4 are not statistically significant nor are 
the effects of sex. It is of interest to note that the groups which did not 
receive visits from the paraprofe'ssional (TV only and control) scored below 
the national norm while the remaining groups scored within >50 of a point 
of the norms,'- -- " ; v. - -' ' f- ' • - 



(14) 




Table 15.8 



Analysis 


of Covariance 


Table 


for ITPA Sub test 4 


(June , 1971) 




Source 


eta^ 


d.f. 


Mean Square 


F 


P 


Trt , 


.01 


3 


25.31 


1.03 


- 


Sex 


.00 


1 


39.88 


1.62 


“ 


Trt. by Sex 


.00 


3 


12,03 


0.49 


= 


Govs * 




2 


43594.91 


1977.25 


— 


Cov. 1 




1 


0.16 


0.06 




Cov- 2 




1 


3469 . 29 


141.16 


- 


Error 


.98 


386 


24,58 







ITPA Subtest 5 (Verbal Expression) 

The purpose of this test is to assess the ability of the child to 
express his own concepts vocally. The child is shown four familiar objects 
one at a time (ball, block, envelope, and a button) and is asked, "Tell me 
all about this." The score is the number of discrete, relevant, and approxi- 
mately factual concepts expressed (Ki rk , McCarthy, and Kirk, 1968, p, 11). 

This subtest undoubtedly reflects several factors other than verbal 
ability. The rapport with the examiner, the child's motivational level, and 
the extent of his previous experience with the objects are all highly impor- 
tant in the quantity of verbal response. 

Means, standard deviations, and sample sizes for Subtest, 5 post- test 
scores are indicated separately for each age group and sex in Table 15.9 
along with overall means for each group on pre and post-test measures. 

Figure 15.5 provides a graphical comparison of j the overall adjusted 
group means for Subtest 5 with means from national norms for comparable 
age groups. Normative means differ because of variations in age among the 
groups. . .. 
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18 




Normative Mean 




14.97 16.00 13.16 16.00 12.13 17,50 

TV-HV-MC TV-HV TV only 

62 mos. 62 mos . 65 mos. 




Control 
5 9 mos . 



Figure 15.5 

Adjusted Overall Group Means and Normative Means for 
I TP A Subtest 5 (June, 1971) 

The differences between treatment group mean scores on Subtest 5 are 
statistically significant as the analysis of covariance summary in Table 
■15.10 indicates, A Dunne t.t’s post-hoc comparison reveals that the TV only 
group scored significantly below the TV-HV-MC, group, indicating the mobile 
classroom in combination with the paraprofessional may have had an effect on 
thi s area of learning. 







Table 15.10 



Analysis of Covariance Table for ITPA Subtest 5 (June, 1971) 



Source 


n 

eta*" 


d. f. 


Mean Square 


F 


P 


Trt . 


.05 


3 


158.49 


6.22 


<,01 


Sex 


.01 


1 


123.82 


4,85 


<.05 


Trt, by Sex 


. 00 


3 


7,68 


0 . 30 


- 


Co vs . 




2 


38739.83 


1440.79 


- 


Cov, 1 




1 


28.15 


1.10 


- 


Cov. 2 




1 


2146.89 


84.19 


- 


Error 


. 94 


386 


25.50 






Addi tional Iv , 


it is 


possible that 


this sub test is 


sensitive to 


the 


occonomi c differences 


which exist 


between the four 


expori mental 


groups . 



Technical Report No. 11, which deals with the demographic and sociological 
differences between groups, shows that the TV only group belonged to a 
lower socioeconomic class than the other three groups. It is hypothesized 
that this uncontrolled factor may account for some of the between-group 
variance evident in the scores on this subtest. 

p significant (p < .05) difference between the sexes also was evidenced 
on this sub test. Table 15.11 shows overall means for each sex by treatment 
cell . 

Table 15.11 

Sex by Treatment Means, ITPA Subtest 5 (June, 1971) 



TV-HV-MC TV-HV TV only Control 



14,60 


12.76 


11.93 


14,30 


15,31 


13.59 


12.43 


14.36 




In every case the females outs cored their male counterparts on this 
subtest, although the difference was greatest for the two groups receiving 
visits from the paraprofessional . It is possible that girls evolved better 
rapport with the home visitor and were thus able to use the visitor’s ex- 
pressive language patterns as a model, 

I TP A Subtest 6 (Manual Expression) 

Subtest 6 taps the child's ability to express ideas manually. This 
ability is assessed by gestural manipulation tests. In this test 15 pic- 
tures of common objects are shown to the child one at a time and he Is 
asked "Show me what to do with a The child is required to panto- 

mime the appropriate action, such as dialing a telephone or playing a guitar 
(Kirk, McCarthy, and Kirk, 1968, p. 11). 

This subtest presumes acquaintance with the object shown to the child, 
and thus becomes a measure of vocabulary as well as of the ability to communi- 
cate nonverbally. Table 15.12 shows means, standard deviations, and numbers 
of subjects for each age and sex group for ITPA Subtest 6 pre and post- test 
raw scores as well as combined scores for each group. 

Figure 15.6 presents overall group means adjusted for age and PFVT raw 
score along with normative means for groups of comparable ages. 
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Pre and Post-test Means, Standard Deviations, and Sample Sizes 
for IT? A Subtest 6 Raw Scores 
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Figure 15*6 

usted Overall Group Means and Normative Means for ITPA Subtest 6 (June, 1971) 



As the ANC0VA table (15. 13) reveals 5 a significant treatment effect was 
evident for this subtest. * 



Table 15.13 

Analysis of Covariance Table for ITPA Sub test 6 (June, 1971) 
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ERIC 



Source 


2^ 

eta 


d,£. 


Mean Square 


F 


P 


Trt , 


.02 


3 


95.60 


2.71 


< *05 


Sex 


.00 


1 


28.21 


0.80 


- 


Trt, by Sex 


.01 


3 


67.14 


1.90 


. - 


Co vs. 




2 


90282.95 


2559.21 


• 


Cov, 1 




1 


83.69 


2.37 




Cov. 2 




1 


5157.31 


146.19 




Error 


.96 


386 


35.28 
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A Dunnet’s post-hoc comparison of means indicates that all three treat- 
ment group means were significantly higher than the control group mean, and 
that the TV-HV-MC group was higher than both the TV-HV and TV only groups. 
This pattern leads to the hypothesis that the television program encourages 
learning and participation in nonverbal communication , and the activities 
on the mobile facility do serve as effective reinforcers for that learning. 

A similar pattern' was evident in the previous year’s results. 

ITPA Subtest 7 (Grammatic Closure) 



The s.ibtest assesses the child’s ability to make use of: 

The redundancies of oral language in acquiring automatic 
habits for handling syntax and grammatic inflections. 

In this test the conceptual difficulty is low, but the 
task elicits the child’s ability to respond automatical- 
ly to often repeated verbal expressions of standard 
American speech. The child comes to expect or predict 
grammatic form so that when part of an expression is 
presented he closes the gap by supplying the missing 
parts. The test measures the form rather than the 
content of the missing word, since the content is pro- 
vided by the examiner.. 

There are 53 orally presented items accompanied by 
pictures which portray the content of the verbal 
expression, ’fhe pictures are included to avoid con- 
taminating the test with difficulty in the receptive 
process. Each verbal Item consists of a complete 
statement followed by an incomplete statement to be 
finished by the child. The examiner points to the 
appropriate picture as he reads the given state- 
ments; for example: "Here is a dog; here are » ” 

(Kirk, McCarthy, and Kirk, 1968, p, 11.) 

Essentially, Subtest 7 measures the ability to follow .the conventional 
rules of grammar and make single-plural and possessive transformations . 

Pilot data gathered by Hooper and Marshall indicated that children in Appa- 
lachia possessed large defects in this area of functioning as did children 
in other "deprived" regions (Hooper and Marshall, 1968, p. 89). Such 
deficits were more in evidence for Sub test 5 than for this measure, however. 

Mean pre and post- test scores, standard deviations, and numbers of sub- 
jects for each age and sex cell on ITPA Subtest 7 are presented in Table 15.14 
as well as overall means for each treatment group. Figure 15.7 presents the 
adjusted group means and the normative means for each treatment- age group. 



Cell Means, Standard Deviations, and Sample Sizes for 
ITP'A Subtest 7 Pre and Post-test Raw Scores 
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Figure 15 .7 

Adjusted Overall Gropp Means and Normative Means for ITPA Subtest 7 

•<June, 1971) 



It is interesting to note that the pattern of means evident m Figure 

15.7 and Table 15.14 is contrary to the earlier^ study of Hooper and Marshall 
In that study, Appalachian children scored significantly below the standard- 
ization group mean on a version of Sub test 7 with similar content. Here 

again we find that Appalachian children are not intrinsically deprived when 

compared to their peers in other parts of the con try. 

Although differences among treatment means are obvious from the above 
figure, the ANCOVA summary table (15 . 15) does not indicate significance 
for these, differences. Y -.Y Y. ' 
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Table 15,15 



Analysis of Covariance Table for ITPA Subtest 7 

(June , 1971) 



Source 



eta 



d.f 



Mean Square 



Trt , 

Sex 

Trt. by Sex 
Govs . 

Cov. 1 
Cov. 2 
Error 



.01 

.01 

.00 



.98 



3 

1 

3 

2 

1 

1 

3 86 



26.27 

95.72 

19.00 

39605.91 

2.04 

2716.66 

28.02 



0.94 

3.42 <-01 

0.68 
1413 . 30 
0.07 
96.94 



Table 15.16 

Treatment by Sex Means , ITPA Subtest 7 



TV— HY— MC TV^HV TV only Control 



14.49 


14.42 


13.81 


. 13.70 


14.46 


15.67 


13.56 


12. ,68 



Males outscored their female counterparts in every group except TV-HV. 
However, large (more than 1 point) ^differences .favoring the i males occurred 
only in the control group (Table 15 . 16) .... ,As with .the previous subtest, 
this pattern is difficult to explain. Yltv may; : :weliib;e Ythatvjhiere as in 
Subtest 6, females visited by a paraprofessionali tend ;to| become more in- 
volved in language model ing than do their male; counterparts^^ and that the 
mobile facility tends to offset this initial advantage for girls. 
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ITPA Subtest 8 (Visual Closure) 
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Adjusted Overal 1 Group Means and Normative 
Means for ITPA Subtest 8 . 






This test is designed to measure: 



The child's ability to identify a common object 
from an incomplete visual presentation. There are 
four scenes, presented separately, each containing 
14 or 15 examples of a specified object. The objects 
are seen in varying degrees of concealment. The 
child is asked to see how quickly he can point to 
all examples of a particular object within a time 
limit of 30 seconds for each scene (Kirk, McCarthy, 
and Kirk, 1968, p. 12). 



This measure probably involves few central mediating processes (cog- 
nition) and provides an estimate of the child's motivation and attentive- 
ness as well as his visual acuity. 

Table 15.17 lists raw score means, standard deviations, and sample 
sizes for each age and sex subgrouping on ITPA Subtest 8. Combined score 
means also are presented in Table 15 , 17 . In Figure 15 . 8 , national norms 
are compared with the adjusted group means from the analysis of covariance 
table. 



2Q 




Treatment Mean 
Normative Mean 





As the ANCOVA summary table (15,18) reveals, differences between treat- 
ment groups are not statistically significant, nor are the differences be- 
tween the sexes significant. 



Table 15.18 



Analysis of 


Covariance 


Table for 


ITPA Subt.es t 8 (June 


, 1971) 




Source 


. 2 

eta 


d.f . 


Mean Square 


F 


£ _ 


Trt, 


.01 


3 


52.70 


1.55 




Sex 


,00 


1 


53.01 


1.56 


- 


Trt, by Sex 


.01 


3 


18.60 


0.55 


- 


Covs . 




2 


48501.32 


1427.76 


" 


Cov, 1 




1 


1149.08 


33.76 


- 


Gov . 2 




1 


658.59 


19.35 


- 


Error 


.98 


386 


34.04 







ITPA Sub test 9 (Auditory Sequential Memory) 

According to the authors , the purpose of this test is to : 



Assess the child’s ability to reproduce from 
memory sequences of digits -increasing in length from 
two to eight digits. The test differs from the digit 
repetition task of the Stanford- Binet or the WISC in 
that the digits are presented at the rate of two per 
second instead of one per second and in ythat the child 
is allowed a second trial of each sequence if he fallsf?!? 
on the vfirst presentation . He receives? more credit for ?' 
a success on the :first than on the second trial.;';, A 
more rapid pres entatio^makes th^’taskleasieri which 'Hi, 
is necessary for the two^ and th<l;threeAyear-old chi ] dren 
(Kirk, McCarthy, and Kirk, 1968fEpp. 12-13) . ' 



Although the format of.-this>;subtest differs?;slightly from that used on 
echsier scales or the ^Stanford- Binet. ,9it duplicates theitypelbf function 

lts • it estimates the child's? a bi li ty to 

^entlyMearned auditorv ^-seauence^lil Thi^^tvnp nf 
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Figure 15,9 presents the overall adjusted group means from the analysis 
of covariance for each treatment group as well as the normative means for 
each treatment- age equivalent sample. 




TV-HV-MC TV-HV TV only Control 

62 mos . 62 mos . 65 mos . 59 mos. 

Figure 15.9 

Adjusted Overall Group Means and Normative Means for ITPA Sub test 9 

(June, 1971) : ' 

As the ANCOVA summary in Table 15.20 indicates, the differences among 
the group means are not statistically significant. It is of interest to 
note that most of the treatment means do not excec the normative means for 
this subtest. It is possible that the fatigue inherent in a lengthy test 
battery reduced the children^ performance on this measure. Again, it is 
interesting to note that no statistically significant difference between 
the sexes existed on this subtest. 
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Table 15.20 



Analysis of Covariance Table for ITPA Subtest 9 (June, 1971) 



Source 


6t9 i 


d.f . 


Mean Square 


F 




Trt. 


. ii 


3 


19.85 


0.64 




Sex 


.46 


1 


85.16 


2.76 


- 


Trt. by Sex 


.26 


3 


48.12 


1.56 


- 


Co vs , 




2 


63081,91 


2044.15 


- 


Cov. 1 




1 


419.01 


13 , 58 


_ 


Cov. 2 




1 


2241,43 


72,63 


-■ 


Error 


,17 


386 


30.86 







ITPA Sub test 10 C Visual Sequential Memory) 

According to the authors : 

This test ' assesses the child's ability to repro- 
duce sequences of nonmean ingful figures from memory. 

A child is shown each sequence of figures for five 
seconds and then is asked to put corresponding chips 
of figures in the same order. Here again the child 
is allowed two trials on each sequence when the first 
attempt is unsuccessful. The sequence increases in 
length from two to eight figures (Kirk, McCarthy, and 
Kirk , 196 , p . 1 3 ) . 

Subtest 10 measures the same short-term memory as the previous subtest 
but does so in terms of visual configurations rather than auditory sequenc- 
ing. It is subject to the same influences and intervening factors as Subtest 
9. Table 15.21 presents pre and post- test age by sex and treatment cell 
means, standard deviations, and sample sizes for Subtest 10 as well as the 
overall means for each treatment group. 

Figure 15.10 presents the adjusted means on Subtest 1,0, derived from the 
ANCOVA, along with the normative means for each comparable age group. 
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15 
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Normative Mean 




10.89 13,33 

. TV-HV-MC 
62 mos . 



, 63 13,33 

TV-HV 
62 mos , 



12,42 14.25 

TV only 
65 mos . 



10.15 12 „ 50 

Control 
59 mos . 



Figure 15.10 

Adjusted Overall Group Means and Normative Means for ITPA Sub test 10 

(June, 1971) 

As the ANC0VA summary table (15.22) reveals , the differences between 
adjusted means evident in Figure 15,10 are statistically significant. 



Table 15,22 

Analysis of Covariance Table for ITPA Subtest 10 (June, 1971) 



Source 


^ 2 . 
eta 


d.£. 


Mean Square 


F 


P 


Trt . | 


.07 


3 


134,52 


7.89 


<,01 


Sex 


.01 


1 


61,49 


3.61 


<.01 


Trt, by Sex 


' .01 


3 


14.73 


0.86 




Covs , 




2 


22793 . 26 


1336.58 




Cov. 1 




,1 


122.15 


7.16 




Cov, 2 




1 


882,16 


51.73 




Error 


.91 


386 


17.05 


■ 






A Dunnett’s post-hoc comparison revealed the TV only group significantly 
outscored the TV-HV and control groups. It is hypothesized that Subtest 10 
falls into Jensen’s ’’Level I” category of abilities (Jensen, 1969) and that 
the trend to lower socioeconomic class of the children in the TV only group 
accounts for their elevated scores in this area. The difference in socio- 
economic status also may account for the TV only group's tendency to score 
slightly lower on Level II or conceptual tasks, such as Subtests 1 and 2. 

The significant difference between sexes on this subtest does not re- 
sult from a consistent pattern of superiority as Table 15.23 reveals. 



Table 15.23 

Sex by Treatment Means, ITPA Subtest 
10 Post-test Raw Scores 





TV-HV-MC 


TV-HV 


TV only 


Control 


M 


11.35 


9.43 


11.58 


10.10 


F 


10.44 


9,80 


13,30 


10.17 



Females outscored males in three of four cases but only in one case was 
the difference more than one point. Males outscored females in the TV-HV-MC 
group by slightly less than one point. It may be that this difference re- 
flects differential fatigue effects or random fluctuations in sampling, 

ITPA Total Raw Score 

The total mean score and standard deviations for all ten subtests are 
presented in Table 15.24 along with sample sizes for both pre and post-tests 
for each age and sex cell of the four treatment groups. 

For graphical comparison of group mean totals. Figure 15.11 presents 
the adjusted overall means from the ANCOVA. National norms are derived from 
summing the individual subtest scores and are also presented in Figure 15.11. 
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Normative Mean 
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Figure 15.11 



Adjusted Group Mean Totals and Derived Normative Totals (June > 1971) 



As the ANC0VA summary table (15 . 25) indicates * the differences between 
overall means are not significant while a statistically significant difference 
between the sexes does exist (p < -05), 



Table 15.25 



Analysis of Covariance Table for I TP A Total Raw Scores 



Source 


===^ 2 == 

eta 


d.f. 


Mean Square 


F P 


Trt • 


.01 


3 


906,95 


1.09 


Sex 


.01 


1 


4315.15 


5,20 <-05 


Trt- by Sex 


.00 


3 


285.43 


0-34 


Co vs . 




2 


5107512.24 


6156.95 


Cov . 1 




1 


9317.23 


11-23 - 


Cov. 2 




1 


262964. 76 


317.00 " 


Error 


.98 


386 


829.55 
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Mean totals by sex for all groups are /shown in Table 15.26, 



Table 15,26 



Treatment by Sex Means - ITPA Total Raw Scores 



TV-HV-MC TV-HV TV only Control 



177.39 


162- 10 


157. 29 


145-84 


169-42 


165 * 61 


159-48 


145-93 



As is evident , neither sex is consistently superior. The males in the 
TV-HV-MC outscore their female counterparts by eight points, while the TV-HV 
and TV only females score two to three points above the males in those groups. 
The control group males and females are essentially equivalent. The most 
likely explanation for this pattern is that the males in the TV-HV-MC group 
were more receptive to program effects and learned more in the area of psycho- 
linguistic growth than did the females whale the differences in other groups 
were not indicative of actual differences in ability. If an actual, overall 
developmental difference in this area did exist, it would be evident through- 
out all groups, including the control sample, and this was not the case. 



Summary and Conclusions 

Although the ITPA did not correspond closely to AEL's Preschool Edu- 
cation Program curriculum objectives. It was, decided to use the 1 1 PA as a 
data gathering instrument which would indirectly measure program effects. 

Three of the ten subtests administered showed significant treatment effects 
after covariance, indicating that there was some correspondence between pro- 
gram and test objectives. 

As was noted before, the covariance analysis was a conservative measure 
of program effects, because the unadjusted means for the treatment groups 
consistently favored the younger sample groups (TV-HV-MC and TV-HV) over the 
TV only sample. Since all of the raw scores on these instruments are positively 
correlated with chronological age, adjusting the group means with age as one 
of the cov aria to s tends to elevate the means score of the TV only and thus 
obscure actual differences among groups. 



For the purposes of comparison, Table 15.27 lists the ranking of each 
subtest on the ITPA across the four sample groups and includes the results 
of the ANOVA analysis of age, sex, and treatment effects. 




Table 15.27 



Rank of I TP A Post-test Means and Results of 
ANOVA by Age, Sex, and Treatment 



ITPA Subtent. 



ft 

It 



ITPA Total 



1 

2 

3 

4 

5 

6 

7 

8 
9 

10 



tv-hv-mc 



TV-HV 



TV only 



Control 



ANOVA for Trt., 



1 


2 


3 


4 


p < . 01 


1 


2 


4 


3 


p < .05 


1 


2 


3 


4 


P < * 01 


1 


2 


3 


4 j 


p < -- 01 - — 


1 


3 


4 


2 


p < .01 


1 


3 


2 


4 


p < .01 


2 


i 


4 


3 


p < .01 


1 


2 


3 


4 


p < ,03 


1 


3 


2 


r 4 


p .< 


1 2 


4 


1 


3 


S. < - 9 1 . 1 


1 


2 


3 


4 


p < - 01 



As Table 15.27 shows, the three-way analysis of variance technique re- 
veal ed significant treatment effects on all ten ITPA subtests and the total 
score. Additionally, the TV only group ranked below the other samples >- n 
terms of mean post-test scores on many of the subtests despite their relativ y 
higher mean age. Thus, it can be assumed that the Appalachia Presehool_Educa 
tion Program was having a broader range of effects in the psycholinguistic 
area than was evident from the covariance analysis. 

Surprisingly, few significant sex effects were evident on the covariance 
despite the fact that traditional developmental theory places girls of this 
atic f 3-5 1/2 years) slightly ahead of their male counterparts m language 
skills Also, the majority of the subtests showed three of the sample groups 
to be scoring near or above national norms. This finding runs contrary to 
the view that Appalachian children are behind their age peers in the rest of 
the nation in language development. 

One significant exception to the above occurred in the results of Sub- 
test 5 which measures expressive language ability. On that test all groups 
scored well below the national norms, and the TV only group produced the lowest 
scores' of all the samples . Although no empirical evidence was available to 
explain this trend, it seems likely that a rural Appal achi an environment has 
a great effect on the child's ability to express himself verbally in a relatively 
unstructured situation. Since the TV only group tended to come from a more 
rural environment and differed only in this respect from the other groups in 
socioeconomic status, this is the most likely explanation for their differing 
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The TV only group also scored below the national norms on seven of the 
remaining nine subtests , providing further evidence for general impover- 
ishment in the psyehelinguistic area. 

Children exposed to AEL f s program evidenced increased ability to express 
themselves nonverbally (by pantomime) one of the frequently taught areas of 
program curriculum. Additionally, children in the TV-IIV-MC group significantly 
Gutscored their cohorts in the TV only group in terms of a measure of verbal 
expression. These findings indicate that a primary area of program effect 
is that of expressive language. This pattern replicates the results of the 
second year's evaluation which also found treatment effects in these areas* 
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